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8.4.5 Likelihood Ratio Tests 

So far we have focused on specific examples of hypothesis testing problems. Here, we would 
like to introduce a relatively general hypothesis testing procedure called the likelihood ratio 
test. Before doing so, let us quickly review the definition of the likelihood function, which was 
previously discussed in Section 8.2.3 . 

Review of the Likelihood Function: 

LetXj, X 2 , X 3 ,... ,X n be a random sample from a distribution with a parameter 9. Suppose 
that we have observed X 1 = x x ,X 2 = x 2 , "',X n = x n . 

- If the X-s are discrete, then the likelihood function is defined as 

l (xi,x 2 , •••, x n ; 9 ) = P xx ... x (x x ,x 2 , •••, x n ; 9). 

- If the X-s are jointly continuous, then the likelihood function is defined as 

L(x x ,x 2 , -,x n , 9) =f XxXr .. x {x l ,x 2 , -,x n , 9). 

Likelihood Ratio Tests: 

Consider a hypothesis testing problem in which both the null and the alternative hypotheses 
are simple. That is 

H 0 : 9 = 9 0 , 

H l :9 = 9 l . 

Now, let X t , X 2 , X 2 ,... ,X be a random sample from a distribution with a parameter 9. 
Suppose that we have observed X { = x x ,X 2 = x 2 , •••, X n = x n . One way to decide between H Q 
and //1 is to compare the corresponding likelihood functions: 

/ 0 = L(x x ,x 2 , —,x n ;9 0 ), l j =L(x { ,x 2 ,—,x n ; 9 X ). 

More specifically, if / 0 is much larger than / j, we should accept // () . On the other hand if/, is 

much larger, we tend to reject 11 () . Therefore, we can look at the ratio ~ to decide between // () 
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and // 1 . This is the idea behind likelihood ratio tests. 

Likelihood Ratio Test for Simple H y potheses 

LetXj, X 2 , X 3 ,... ,X n be a random sample from a distribution with a parameter 9. Suppose 
that we have observed X 1 = x h X 2 = x 2 , "-,X n = x n . To decide between two simple 
hypotheses 

H 0 : 6 = 9 0 , 

H l :0 = 0 l , 
we define 


X(x v x 2 , = 


L(x l ,x 2 , 0 q) 
L(x\,x 2 , ••■,x n ; 0 { y 


To perfonn a likelihood ratio test (LRT), we choose a constant c. We reject H 0 if X < c and 

accept it if X > c. The value of c can be chosen based on the desired a. 

Let's look at an example to see how we can perform a likelihood ratio test. 


Example 8.30 

Here, we look again at the radar problem ( Example 8.23) . More specifically, we observe the 
random variable X: 


X=6+W, 


where W ~ N(0, a = -). We need to decide between 


H 0 : 9=9 0 = 0, 

H l :0 = 0 l = 1. 

Let X = x. Design a level 0.05 test (a = 0.05) to decide between H Q and . 
• Solution 

o 1 

o If 6 = 9 0 = 0, thenX ~ /V(0, rr = -). Therefore, 


https://www.probabilitycourse.com/chapter8/8_4_5Jikelihood_ratio_tests.php 


2/5 



9 / 18/2018 


Likelihood Ratio Tests 


3 9 * 


L(x; 0 O ) =fx(x; 0 O ) = ~j=e 2 . 

A/2?r 


On the other hand, if 0 = 6 X = 1, thenX ~ N(\,o z = -). Therefore, 


3 9(x— 1 ) 2 

L(x; 0 X ) =f/x; 0 X ) = -j=e 2 


Therefore, 


L(x; 0 Q ) 

i(l) = I(^3 = exp i"T + 2 


9x 2 9(x - 1 y 


exp 


( 9(1 -2x) 


Thus, we accept Hq if 


( 9(1 ~2x)) 

eX P | 2 j “ C ’ 

where c is the threshold. Equivalently, we accept Hq if 




Let us define c = ^ ^1 _ 9 Inc I, where c is a new threshold. Remember that x is 

the observed value of the random variable X. Thus, we can summarize the 
decision rule as follows. We accept Hq if 


X< c . 

How to do we choose c ' 2 We use the required a. 
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./(type I error) = /’(Reject H 0 \ // () ) 

= P(X > c' | H Q ) 

= P(X> c ) (where X ~ /V^O, ~ j ) 

= 1 -0(3c'). 

Letting ./(type I error) = a, we obtain 

, 1 

c = -O (1 - a). 

Letting a = 0.05, we obtain 

' 1 -l 

c = -® ! (.95) = 0.548 

As we see, in this case, the likelihood ratio test is exactly the same test that we 
obtained in Example 8.23 . 


How do we perform the likelihood ratio test if the hypotheses are not simple? Suppose that 8 
is an u nkn own parameter. Let S be the set of possible values for 6 and suppose that we can 
partition S into two disjoint sets S () and S Consider the following hypotheses: 


H 0 : 6 6 S 0 , 

H x : 0 G S v 

The idea behind the general likelihood ratio test can be explained as follows: We first find the 
likelihoods corresponding to the most likely values of 8 in S 0 and .S’, respectively. That is, we 

find 


l 0 = max {L(x v x 2 ,---,x n ;6):8 E S Q }, 

1= max {L(x x ,x 2 , 0): 8 G S}. 

(To be more accurate, we need to replace max by sup .) Let us consider two extreme cases. 
First, if /q = /, then we can say that the most likely value of 0 belongs to S (y This indicates that 

lo 

we should not reject H Q . On the other hand, if — is much smaller than 1, we should probably 
reject H 0 in favor of H x . To conduct a likelihood ratio test, we choose a threshold 0 < c < 1 
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l 0 l Q l Q 

and compare y to c. If y > c, we accept H Q . If y < c, we reject H Q . The value of c can be 
chosen based on the desired a. 

Likelihood Ratio Tests 


LetXj, X 2 , X 3 ,... ,X n be a random sample from a distribution with a parameter 6. Suppose 
that we have observed X 1 = x 1? X 2 = x 2 , •••, = x n . Define 


Kx i,- 


' 2 ’ 


sup {Z(xj,x 2 , 6>): 6» G S 0 } 

sup {L(x l ,x 2 , -,x n ;d):d G S} ' 


To perfonn a likelihood ratio test (LRT), we choose a constant c in [0, 1], We reject H 0 if X < c 

and accept it if X > c. The value of c can be chosen based on the desired a. 

<— previous 
next —> 
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